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ABSTRACT 



The possible utilities and limitations of computer-assisted 
career guidance systems (CACG) have been widely discussed although the 
effectiveness of CACG has not been systematically considered. This paper 
investigates the effectiveness of a theory-based CACG program, integrating 
Sequential Elimination and Expected Utility strategies. Three types of CACGs 
are examined: (1) Career Decision-Making (CDM) is a program that teaches 

theory-based career decision-making strategies; (2) Self -Directed 
Search-Computer Version (SDS-CV) is useful for clients who indicate a lack of 
adequate self-knowledge that relates personal characteristics to occupation; 
and (3) CHOICES has a strong emphasis on information access and retrieval. 

The results suggest that it is possible not only to integrate two 
decision-making strategies, but also that the integrated approach is 
effective in increasing students' vocational identity. The information 
approach (CHOICES) also had a significant long-term impact on students' 
vocational identity, but fell short of significant short-term effect. 

Students appear to favor the use of SDS-CV over CDM and CHOICES. The findings 
of this study may provide counseling practitioners with evaluative 
information for making purchasing decisions, but the paper cautions 
counselors from making decisions based on a single factor. (Contains 25 
references and two tables . ) ( JDM) 
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The use of computer technology fcK* career counseling has become a kandaidized practice among counseling 
professionals since its first introduction to the field. The possible utilities and limitations (rf computer-assisted caj^ 
guidance systems (CACG) have been widely discussed (e,g., Harris-Bolsbey, 1984; Gati, 1 W5; Katz, 1993» Sampson, 

1983). The cost analyses and the evaluation of CACG have also been documaited (e.g., SampstHi, Reardon, Humphreys, 
Peterson, Evans, & Domkow^, 1990). However, the effectiveness of CACG has not been systematically investigated as has 
other traditicmal counseling aj^roaches. The m^raity of CACG studies were conducted during 70s and 80s. Due to the vast 
and rapid change of the delivay system and computer softwares, continued research and evaluation of the effectiven^s of 
CACG is needed. The purpose of this study is to compare aiul evaluate relative effectiveness of different approaches to 
computer-based career interventicms. 



CACG systems provide many attractive features for experimental research on career decision-making, largely 
due to its standardization of treatment jKOcedure and replicability of results (Jepsen, 1990). CACG systems also provide 
a linkage between theory and practice (Walsh & Savickas, 1996). Despite the potential of CACG, these systems have 
cot received enough attention in the field of counseling psychology (Gati, 1996). 



Although there are more than a dozen popular systems, studies have been unevenly focused on a few programs such 
as DISCOVER and SXGL Mo^ of the CACG studies concentrated on likability these systems and its short-term effects 
Very few studies focused on the effect of the systems on individuals* vocational identity or career development over an 
extended period of time. Moreover^ CACG programs ve complex systems, effects on users are likely the product of complex 
interaction, theref<m. Isolate components of a large system, and investigate the interactions with other system components is 
important (Jepsen, 1990). 



Most of the CACG systems deigned to assist an individual in lemnining about themselves (career assessment 
approach), or learning about the world of wojk (caresr exploration ajp^oach). Very few systems are designed to teach 
bdividuals about how to process career inform^oo. If the the ultimate; goal career intervention is to help individuals 

become independent and responsible career problem-solvers and deciskm-makers, then the teadiing infonnation {nx>cessmg 
skills and decisioo-making sUategies must be developed (Sampson, Peto^« & Reardon, 1989). 



Career decision-making is a complex process, by which individuals organize information about thOTiseives and the 
w(xld of work, deliberate axhmig alternatives about actions, and make a public commitment to action (Jepsen, 1984). It has 



(Gati, 1997; Glass & Holyoak, 1986; Kahneman & TVersky, 1979). Given the complexity of the decisiem^aking process, 
and the limitations of human cognition, teaching individuals to uiKlerstond the decision process and aj^xbpriate career 
decision-making strategies become critically important 
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Studies (Egner & Jackson, 1978; Jepsen, Dustin, & Miars, 1982; Krumboltz, Seberba, Hamel, & Mitchell, 1982; 
Rubicon, 1980) have the effectiveness direct tMrhinj about decision^makii^ strate^es. Very.few studies have 
investigated the effectiveness of teaching career-decision making via ctxhputers. Johnson (1985) used mio^ocomputers to 
teach steps in the drasion making process and help students learn how to use pmonsd interest values, and abilities to 
evaluate care^ t^ons. We found that the students in the computo’-assisted group perceived the career exploration to 
more enjoy^e and helpful than did students in the counselor-assisted groi^. Mau and Jepsen (1992) cooipared two themy- 
ba^ decision-making models. Subjective Expect^ Utility and S^uential Elimination {described in the method section), 
using microcomputers. Results indiesUe a differential impact of the strategies on choice anxiety, diokecdtainty, and 
complexity .(rf reasons for choosing a college major. Based on these findings and suggestions ffom Gati (1986), it may be 
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maHng 

•Hu. «f this Study is to investigate ibe effect of a conqwter program combining Expected UtiUties and 

Himinatio^rA^ st«tegi^ on vocational idatity and career exploratory behaviors. The relative 

efifecdveoeaa ^^woacfaes were also examined. Specifically, the fi^owing questions were addressed in this 

A. l>o“ teaching career dedskm-making strategies (CDM) result in a greater vocational 
identity and career exploratory behaviors? 

B. ^w do^ CI^ a{^oadi compile with career intoest assessment approadi (SDS), 
infonnatioQ aj^oach (CHOKES), and a ctanbinadon a^^oach (SDS + CDM)? Which 
approach has gretdo- long-term effects? 

C. Ifow are tte CACG programs received by students? 

rw^ia^ Vocati^ identity is defined as the possession of a clear and stable picture of one’s goals, interests, and talents 

J<*nstoa. & Aaana, 1993). Vocational identity has been found to associate with Job s^sfaction, vocational ‘ 

attihaJ^ positive career belief, dearaWe problem solving attitude, and rational decision-making | 
al! 19^. scale has been Its use as a pre-/post criterion for evaluating career intervention (Holland et j 

and acouire ^ individuals seek to assess tbemselves l 

have^^J^Sr^n^ri!^^ decision-making gordaan. 1963). Career exploratory behaviors 

^ be predictive of vocational commitment (Blustein, 1989), vocational maturity (Yongue, Todd, & Burton 

(JepsL^W^ (CSrotevant, Cooper, & Kramer, 1986), and confidence in one’s vocational chS 
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Sample* 



Methods 



dwdi^moit classes «a^westero state university. Students (approximately 140) enrolled in these dLses were primarily I 
S^r 140«udcnts, 121 agreed to partid Ofthe 121 volunteers. 108 completed the stud^ ^ 

4 j> Yhp ° stiidy were given extra course credits. The mean age was 25.9 fSP = ranging from 1 8 to 

48. The mqjontyof partKipaots (over 90%) were Caucasians. o-oA ranging irom t» to 

CACG Pmpramc 

ty^ of CACXte wereexamined. Ptogtam descriptions are briefly stated as followings: 

. P^sion-Making (CDM). CDM k accmpittef-assisted instmctioaprogram that tiv»nry>b fl^ 

instruction program w^ created b^toe^ror based on S^ision- 
(19^ Tire S ubject i ve fanected TTtili l y as described by G^ (198Q and Katz 

^ (a) Generating a list of choice posiibilitii; (b)^ying a list 
? Eliminating possibilities by aspects; and (e) OrdeSg the sumving alternatives. 

^ sections: (a) Identifying and comparing values, (b) Estirnating expitancies, (c) 

ForeachLion.iitL:tiS^ 

National Card ,^prf (Jones, 1980). AJist of 

occ^^ an^onnatwo res^ e.g, career placement services, is included in the computer ikogram along with 
^e^ns enhow to searchfor additional, trff-line information. Lichlenberg. Shaffer, arkrA^hlkriGl^) baL also 
c^jpared St^ve Expected Utflity and Sequentid Elintinationdecisicm rSi^ 

study suggested that the Expoted Uti% ntodd yiekled signifk^ 

interventi ^^S^li!^ VtTiio n (SM-CV; PAR. 1987). As both a vocational assessment and an " 

vocational and the number 
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an i^rebve report iiiduding an overvkw of the six HoUand types. The report also iMludes sugge^^ 

the SDS resulte m eaner aod educadoDal planning, and a Ust of reference malaials. SDS-CV has been used to assist 
“those cliente mri i oating a lack of a d equa te self-knowledge or schana with which relates to personal rharartp-nctirs to 
occupations” (Readon, L eaz, fe Strausberger, 1996; p, 213). 

Hem s ac Occ u p ati o aal Ml^ a dpn md Career Exploration System / fTHniTP*; CarcCTware, 1996). 

CHOICES has a strttog emphasis oh infonnation access and retrieval. There are five modules in the Choices twogram; 

(a) Guided Access, (b) Tutorial, (c) Plaanhr, (d) Assessment, and (e) Quick Access. In this study wily the Guided 
.\cce« module was us^ to represent the irfocmation a^iroach of the CACG interventions. The Guided Access module 
cimtains a search function that allow uKhviduals to explore ocaq»tiohs based on their selected criteria as 
^tude, te m p a -ame gi ts, This mo^ also allows indivkhials to compare two or duee occupations, and search 
related occupations. Studies have indic ated that CHOICES was well reedved (e.g„ Reardon, B<»ndl, & Huddleston, 

1982). and increased career decision making commitment (rf college students (e.g„ Finder & Fitzgerald, 1984). 

Procedure 

Students who participated in this study were randomly aligned to one of six groigis: (1) CDM, (2) SDS, (3) 
Choices, (4) SDS + C^M,- (5) wait-lirtied coihrd, and (6) Holdout group. A total of 25 two-hcHir sessions were 
ovCT a two we^ period. Due to linuted avdlability oi con^Hiters Kid the st^ware programs, seven participants wctc 
assipied to a different group because none <rf the originally a^ijgned group sessions fk their schedule. Conrequaitly, each 
session varied- with a number of st u d ent s participating. In each session, a graduate research- assistant was available for 
introducing the computer system and answering questions. 

Students who pKticipated in any of the first four CACG groups compacted the My Vocational Situation 
questionnaire (MVS) one week before they received the treatment, and wctc administered the MVS and a computer pHOgram 
evalua^ questionnaire iaimediately after the treatment A career exploratory behavior checklist and MVS were 
adminirtered to the treatment groiqj six months after they reedved the treataient Stodents in the wait-Ksted control group 
canpl^ MVS twice in the same one-week period before they received the treatment Students in the hdd-out group were 
adminirtered MVS and the career exploratory behaviors checklist during the fdlow-up period. Students in the hoW-out 

groiQ) received no treatment during the research study period. 

yn<!tniment 

Yoc ah ona l Idgntlty . My Vocational Situatitm ( H olla n d, Daiger, & Power, 1980) measured vocational identity, the 
^ for iirfonnation, and perceived bariiers to career decision-making. The vocational identity scale, of 18 items, 

is defined as “ the poss^^ of a cl^ and stable picture of one’s goal, interests, personaiity, and talents” (p j„ Holland, et 
al, 1980). The score reliability (KR 20) is .89 for 291 college males, and .88 for college females. MVS has been gaining 
empirical support as a valid diagnostic tool (HoUand. et al„ 1993; Lucas, Gysbers, Buescher, & Heppner, 1988). 

Car^ F i Xplnfatnry Bchavil gs. A c h ec k l i st incli^iiig 20 possible sources of infcKThation- was develcped by the 
author. Participants were asked to indicate how often they had tought each infonnation since they received CACG. Both the 

numbo’ of sources and the total ftequencies of infcKinrtion sought were assessed. 

S a t i sfact i on Rati ngs. Students satisfacticm with the {vograin was measured based on a questitHuiaire cmiposed of 
10 self-descriptive sta t e m e n ts, for exaiqile, “Using this {xogram helped me to make the educational/vocational decisions.” 
Items were derived from several studies, including Zener and Schnuelle (1972), Ryan and Drumm(md (1981), and Mau and 
Jqisen (1992). Students rated each of the 10 statements using a 5-point Likert scale (from 1, strongly disagree, to 5, strongly 
agree). For the fust ei^t s t ate men ts, a high rating (3 and above) indicated a positive reaction to the program utilized; for the 
last two s ta te m en t s, a high rating ipdierted a n^ative reaction toward the prt^ram. Ratings for the last two kans were 
xeversed when the total srtisfactina ratings were eorapmered. The alpdia coefficient ertimated for this san^e was .76. 

Results 

latest and posttertdffieiences in vocational kJeotityaniong CACG and wait-list control groups were 

examined using a 5 (groups by 2 (sex) analyses of variance (iWOVA). Pte-test and follow-up tert diffeiences in 

‘dentity and career mqdoratory bdiaviors among CACG and Hold-oik groups were also examined using a 5 x 
wa satis f action with CACG pirograms (ix., CDM, SDS-CV, and Choices)' was examined using one- 
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T'-Ki-i -j j ^v^ai ideBdtvscoregbygoupsaadReBder.Regultgirf 

Aion VA Sy for groups, E(4. 87) = 2.69. j, < 037 . There were 

ANOVA Bdroto a short-renn ^ Post hoc aualysi* indicated that students who 

no stpuE^ 8^ vocadonal identity than students who 

parttop^ m the of ANOVA also indicate a significant long-term gain in vocadtmal identity 

received no dmc^ M hoc analysis showed that students in CDM (M = 2.76), or Choices group (M 



Table 2 provides means and standard deviatioas of career explaatory behaviors by group and gender. Results 
ANOVA iadicate a significant group by sex interaction for soiace of infonnatioa eaqtoed, E(4. 69) » 3.03, a <■ 024, 
^ in the total fiequeodes of information sought . E(4, 87) = 3.49. p < 013. Post hoc analyses showed that male 



30 d in tbe iow ©“• * A.\-» V r/ — ^ vAj. x-v5i uut mKuyscs soowea ttiai male 

_ticipams in the CDM group <M= 112) sougltf significantly more sources cfMonnatitm than male participants in the 
hold-outgroup 5.0). 



ANOVA showed a significant difference in satisfaction ratings among different CACG program, £(2. 55) = 
4.42, p < . 017. On the average, students who used the SD-CV program (M * 43.1,^ » 5.1) reported ^ter 
satisfaction than those who used CDM (M = 36.0, SJ2 = 7.9) or CHOICES (M = 36.9, = 8.4) program No 

significant gender difference were found. »- o* • 



Discussion 

n investigated the effectiveness of a theory-based CACG iHogram, integrating Sequential Hiniination 

^ Utility strategies. Results suggested that it is not only possible to integrate two decision making strategies, 

tat also mdic^ that the integrated a^Hoach is effective in increasing studMits’ vocatkmal identity. Teaching career 
dTOioOTHnaking strategies using microcomputer not wtly r^ted in a short-term gains in students’ vocatitaal identity, 
this effect seems to have a hmg lastmg impact The irfformation aHrroach (Choices) also had a significant long-term 
imp^ on stud^’ vocational idratity, but fell short of significant dwrt-tenn effect Although SDSCV did not 

sipuficantly raise students’ vocational identity sewes, students appeared to favw the use of SDS-CV ove- CDM and 
Choices. 



Unexpectedly, tta combined approach (SDS+CDM) did not significantly increase students’ vocrhimial identity. 
Several possible explanations are contemplated. The arrangement to do both computer programs were difficult to mat-*- 
coosequentiy, fewer students showed up for the experiment The considerably smaller sample size for the combined 

Buy tave resulted in lacking statistical powerfor a significant effect It is also possible that ceiling effect may 
ta a factor for this non-sighificant finding. University career counseling clients typically have a average vocational 

id^ty score <rf8_(Reardon, 1997; personal communication), the sample fi-om this study ermsisted nfnrtn.«»iy 

and senior umveraty students who were likely to have theh career goals well thtaght out and fon^^ 



Omsuteat with other stodres aohn«m, 1985; Miller. Karriker, & Springer. 1986), the present study did not 
^w^n^ effects of ^ treatment programs on vocational identity. However, gender and treatment interaction was 
found fortoe^measure of vocational exploratory behavior. Male students in the CDM group sought significantly more 
smirces of irfwmation than male participants in the hold-out group. The fact that the CDM program does not contain 
formation, and its of strategy to obtain off-line information, seemed to have motivated male 

tim female stunts to seek information from diverse sources. However, due to a relatively sroaU male sample 
size m each group, one should interpret the findings with reservation and make tentative r/wrlnsinns. 



T* «P»<«tory behaviw generaUy considered two important predictors for I 

var^ of car.^ behavrers and mruorcareer mtervention goals. Giventhe complexity of decision-Sgnrocess, anS^S 
h^<^ of bu^ mfomiatioa processing, cornputer-assisted career intavention programs can be used to break dowiil 
mtomation into^lMte axi ’’pk^’’ therefore, reduce the “informal Teaching career decision-making caS 

ctasui^agresid^ofacoi^ use of CACG for teachmg career decision-makmg not tmlyenha^ 

aw^rm prod^^ty. but also becomes a logical solution for often criticized compensatory decision model (Gati, IS 

Glass& Holyoak,1986;TVersky,1975). v 



The findings of this study may provide counseling practitioners with evaluative infnrmarinn fnr mainnj, p, 
decisions. Although students were more satisfied with the SDS program, both CDM and Choices programs were i 
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positively. More than SO% of students from either jH-ogram indicated that they will suggest their friends to use the program. 
However, counselos should avoid nuddng decisions based on single factor. Cost-effect analysis (e.g., Sampson, et al.. 1990) 
would provide useful infamatioa to the practitioners. 
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vf>.aT,c amt Tk^atinns of Vocational Idenritv Bv Treatment nmiip^ a nd Gender 





Pretest 


Posttest 


FoUom 


CDM (n - 23) 








M 


13.1 


15J 


16.4 


212 


2.8 


2.4 


1.5 


SDS(n=14) 








M 


13.6 


14.1 


15.0 


212 


3.6 


4.0 


3.2 


CHOICES (n = 21) 








M 


11.0 


12.3 


14.8 


212 


4.4 


4.6 


3.2 


SDS+CDM(n= 13) 








M 


12.9 


14.9 


15.0 


212 


3.8 


3J 


3.1 


Wait-Listed Connol ( n = 16) 








M 


13J 


13.6 


_ 




3.7 


3.9 


- 


Hold-Out Group (ns 21) 








M 


14.7 





15.4 


212 


2.6 




2.1 


Males (n»26) 








M 


13.7 


14.1 


15J 


212 


3.8 


4.0 


3.1 


Females (qs g2) 








M 


12:8 


14.8 


15.6 


212 


3.7 


3J 


2.7 



Nxae. Students in the Hold-out gioi^ only participtUed in the follow-tq) study. Students in the wait-listed contrtd gro 

“ OKJKES pii^iam after the posttest was sdministered. Average scores and standi dcviati 
lor VI IS \Au/iA. Tlic higher the VI score the greater the career certainty. 
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Table 2 



Vfeans an ^ Stanrbryt 

Treatment 

Groups 



of Exnlorafnr y Behaviori; 

Number of Sources Explored 
Maififi FematPc 



■ Sy Treatment Grniip<; anH GenrlPT 



Frequency (rf Ejq)lK-ation 
MalfiS Ep.malpg 



CDM 



M 

sn 




112 

3.1 


62 

2.6 


592 

34.4 


19.6 

183 


SDS 












M 

SR 




6.0 

2.8 


6.0 

33 


593 

55.9 


19.4 

14.4 


CHOICES 












M 

2I> 






7.6 

3.1 


113 

10.8 


27.7 

303 


SDS+CDM 


• 










M 




9J 

3.1 


8.1 

2.7 


38.3 

24.7 


25.9 

163 


Hold-Out Group 
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2.8 


6.1 

2.4 


19.8 

212 


17.4 

10.6 
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